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150 Spear Street, Suite 800 
San Francisco, CA 94105 
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UNITED STATES DISTRICT COURT 


NORTHERN DISTRICT OF CALIFORNIA 


UAB "PLANNER5D" dba PLANNER 5D, Case No. 


Plaintiff, 


COMPLAINT FOR 


v. 


1. COPYRIGHT INFRINGEMENT; 


FACEBOOK INC., 

FACEBOOK TECHNOLOGIES, LLC, THE 
TRUSTEES OF PRINCETON 
UNIVERSITY, DOES 1-200, ABC 
CORPORATIONS 1-20, and XYZ 
UNIVERSITIES 1-20. 


2. TRADE SECRET 

MISAPPROPRIATION (DTSA); & 


3. TRADE SECRET 

MISAPPROPRIATION (CUTSA) 


Defendants. 
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UAB "Planner5D" (Planner 5D) complains against Facebook, Inc., Facebook 
Technologies, LLC (together, Facebook), and The Trustees of Princeton University 
(Princeton or Princeton University) as follows. 

INTRODUCTION 

1. Computer vision—the ability of machines to recognize three- 
dimensional scenes—is one of today's leading research fields. Whoever first masters 
this technology will forever change humankind's relationship with machines. 

2. Scene-recognition technology will soon enable robots to care for home- 
bound patients, and to boost safety and productivity at offices, airports, hospitals, 
and factories. It will also revolutionize an array of applications outside of robotics. 
One product looks after elderly people in their homes, using computer vision to 
detect changes in their gait or behavior, and to recognize stumbles or falls. Other 
applications will usher in a new era in virtual reality. Virtual objects will be 
seamlessly integrated into the user's actual indoor environment, enhancing realism 
for both industrial and recreational applications. Shipping giant DHL has already 
equipped its warehouse employees with "smart glasses" that use scene recognition 
to display where each item picked from the warehouse should be placed on the 
trolley for delivery. It's been estimated that the computer vision market will reach 
$48 billion by 2023, and $60 billion by 2025. 

3. Yet even as scientists make great strides in this burgeoning research 
area, they have encountered a roadblock. Teaching machines to recognize three- 
dimensional settings requires feeding them large volumes of realistic, digitized 
renderings of such places—digitized doors, walls, furniture, and the like, arranged 
into plausible interiors and rendered in three dimensions. Creating lifelike digital 
scenes is extremely time- and labor-intensive. For truly realistic scenes, human 
modelers must personally craft each three-dimensional object, and human designers 
must arrange the objects in real-life configurations. Large collections of these kinds 
of three-dimensional settings are thus exceedingly rare. 
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4. Yet such collections are vital to scene-recognition research. In a slide 
presentation posted online, a senior Princeton computer scientist asked, "What is the 
main roadblock for 3D scene understanding and research?" His answer: "Data!!" 

(See Thomas Funkhouser, 3D Data for Data-Driven Scene Understanding, 8-9, 
https://www.cs.princeton.edu/~funk/VRWorkshop.pdf (last visited June 4, 2019).) 

5. Planner 5D owns a collection of over a million hand-crafted, digitized, 
and realistic three-dimensional objects and scenes, depicting a wide variety of 
household and office designs. To Planner 5D's knowledge, no other collection in the 
world numbers even in the tens of thousands. The company created and grew its 
collection over many years, at a cost of millions of dollars. It began by creating 
several thousand hand-crafted three-dimensional objects. These were lifelike 
renderings of furniture, appliances, plants, people, lighting, or other objects that 
could occupy the interior or immediate exterior of a structure. The company then 
compiled a catalog of scenes made from arrangements of its individual objects. Over 
many years, its collection of human-created scenes grew from tens of thousands, to 
hundreds of thousands, to over a million. 

6. Computer scientists at Princeton were eager to use this uniquely large, 
uniquely realistic collection of data. They decided to download the entirety of 
Planner 5D's data collection. To do so, on information and belief, they or others 
acting at their behest created computer code that crawled through thousands or tens 
of thousands of pages within Planner 5D's servers, progressively cataloging the 
locations of all available objects and scenes. Then they scraped this data, 
downloading over 2,500 of Planner 5D's objects and over 45,000 of its scenes. 

7. In all, Princeton downloaded over five gigabytes of Planner 5D data. It 
then used this data for its scene-recognition activities. Princeton researchers 
published multiple articles using the data. The articles did not disguise the data's 
provenance: "We use a collection of 3D scene models downloaded from the 
Planner5D website." (E.g., Yinda Zhang, et al, Physically-Based Rendering for Indoor 
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Scene Understanding Using Convolutional Neural Networks 3 (Proceedings of IEEE 
Conference on Computer Vision and Pattern Recognition, 2017) 
https://arxiv.org/pdf/1612.07429v2.pdf .) (last visited June 4, 2019).) 

8. Princeton also posted the data to a publicly-accessible Princeton URL, 
thereby offering Planner 5D's painstakingly developed data to anyone to download 
and use. Princeton labeled the stolen data the "SUNCG dataset." 

9. Also interested in Planner 5D's objects and scenes were defendants 
Facebook, Inc. and its subsidiary, Facebook Technologies, LLC (together, Facebook). 
Facebook Technologies runs "Oculus," the well-known virtual-reality brand 
Facebook acquired in 2014. Scene recognition is a vital component of virtual-reality 
products and services. As one example, "scene fusion" — the fusing of virtual objects 
with the user's actual surroundings—relies critically on scene-recognition 
technology. 

10. Eager to tap the enormous commercial potential of scene recognition 
technology, Facebook assembled its own, internal, computer-vision team. This team 
then enlisted broader aid in its research. With help from researchers at Princeton, 
Stanford, UC Berkeley, Georgia Tech, and others, Facebook launched an international 
scene-recognition competition called the SUMO Challenge (Scene Understanding 
and Modeling Challenge). (See The 2019 Scene Understanding and Modeling 
Challenge, https://sumochallenge.org/ (last visited June 4, 2019).) 

11. SUMO Challenge entrants were encouraged to submit scene- 
recognition papers and algorithms. Facebook promised contest winners cash prizes 
and a speaking slot at a "SUMO Challenge conference." This year's conference is 
scheduled for June in Fong Beach, California. To facilitate contestants' work, 
Facebook and its SUMO Challenge affiliates created their own copy of the SUNCG 
dataset, and directed contestants to use it for their contest submissions. Facebook 
published a link to the copied SUNCG dataset, at a URF belonging to Stanford 
University—itself a SUMO Challenge participant. 
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12. In return for their chance at cash prizes and the opportunity to present 
their winning submissions, SUMO contestants granted Facebook a "perpetual, 
royalty-free, no-cost license and right to use and otherwise exploit" the submitted 
materials, including Facebook's right to use the contest submissions "in any 
merchandising, advertising, marketing, promotion or for any other commercial or 
non-commercial purpose." 

13. The gigabytes of data Princeton, Facebook, and an unknown number of 
others have downloaded and used are the intellectual property of Planner 5D. 
Planner 5D's data was scraped, copied, and used without its knowledge or 
permission. Defendants' copying, use, and public disclosure and dissemination of 
Planner 5D's core asset has caused catastrophic and potentially permanent damage 
to the company. 

JURISDICTION 

14. This case arises under the United States Copyright Act, 17 U.S.C. §§ 101 
et seq., the Defend Trade Secrets Act (DTSA), 18 U.S.C. § 1836 et seq., and the 
California Uniform Trade Secrets Act (CUTSA), Cal. Civ. Code § 3426 et seq. 
Accordingly, this Court has subject matter jurisdiction under 28 U.S.C. §§ 1331 
(copyright and DTSA claims), 1338(a) (copyright claim), 28 U.S.C. § 1836(c) (DTSA 
claim), and 28 U.S.C. § 1367(a) (supplemental jurisdiction over CUTSA claim). 

15. The Court has personal jurisdiction over Facebook, Inc. and Facebook 
Technologies, LLC because each is headquartered in California. 

16. The Court has personal jurisdiction over Princeton University because, 
on information and belief, Princeton, together with its current and former employees 
and students has engaged in the following acts: 

• participated in and assisted with the SUMO Challenge in California, 
including as SUMO Challenge organizers and advisors; 

• worked with Facebook and other California-based companies, 
individuals, and institutions involved with the SUMO Challenge; 
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• received "generous support" —presumably cash funding—for scene 
recognition work from Silicon Valley companies such as Facebook, Inc., 
Google LLC, and Nvidia Corporation. 

• permitted the copying and storage in this district of the SUNCG dataset 
used in the SUMO Challenge; 

• made its own copy of the SUNCG dataset generally available for 
download in California, an invitation that on information and belief at 
least some California residents accepted; 

• co-authored articles with California residents about the SUNCG 
dataset, and specifically its origin as data downloaded from 
Planner 5D; 

• consented to and enabled the current sabbatical here, at Google and 
Stanford, of Dr. Thomas Funkhouser, one of Princeton's leading 
computer-vision professors. Dr. Funkhouser co-authored articles 
dealing with Princeton's use of the Planner 5D data and serves as one 
of four members of the SUMO Challenge Advisory Board; and 

• accepted Facebook's support of another of its key scene-understanding 
researchers. Dr. Shuran Song, via a "Facebook Fellowship." 

VENUE 

17. Venue is proper in this district under 28 U.S.C. § 1391(b), because a 
substantial part of the events giving rise to the claim occurred here, and because all 
defendants are subject to the Court's personal jurisdiction here. Venue is also proper 
under 28 U.S.C. § 1400(a), because the defendants and their agents either reside or 
can be found in this district. 

INTRADISTRICT ASSIGNMENT 

18. This is an intellectual property action subject to assignment on a 
district-wide basis. N.D. Cal. Civ. Local Rule 3-2(c). 
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PARTIES 

19. Planner 5D is a private limited liability company organized under the 
laws of the Republic of Lithuania. 

20. Facebook, Inc. is a Delaware corporation with headquarters in Menlo 
Park, California. 

21. Facebook Technologies, LLC is a Delaware limited liability company 
headquartered in California. It is a subsidiary of Facebook, Inc. 

22. The Trustees of Princeton University is a non-profit educational 
corporation and academic institution in New Jersey. In this complaint, "Princeton" 
refers to the university, its employees, agents, and others acting at its behest and 
direction. 

23. Does 1-200 are individuals whose names and identities Planner 5D does 
not presently know, but who, on information and belief, committed or facilitated the 
copyright infringement, trade secret misappropriation, or other acts or omissions 
alleged here. Planner 5D will add the names and identities of these Doe defendants 
when it learns them. 

24. ABC Corporations 1-20 are business entities or unincorporated 
associations, whose names, states of organization or incorporation, and entity types 
Planner 5D does not presently know, but which, on information and belief, 
committed or facilitated the copyright infringement, trade secret misappropriation, 
or other acts or omissions alleged here. Planner 5D will add the names and 
identities of these business entities or unincorporated associations when it learns 
them. 

25. XYZ Universities 1-20 are academic institutions whose identities, or 
whose exact role in the events alleged here. Planner 5D does not presently know. On 
information and belief, some of these academic institutions committed or facilitated 
the copyright infringement, trade secret misappropriation, or other acts or omissions 
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alleged here. Planner 5D will add the names, identities, and roles of these academic 
institutions when it learns them. 

26. On information and belief, in committing the acts or omissions alleged 
in this complaint, each defendant conspired with, aided and abetted, or acted in 
concert with each other, and each acted as the agent of each other. Under principles 
of respondeat superior and like principles, employer defendants are liable for the acts 
and omissions of their employees and agents. 

GENERAL ALLEGATIONS 

A. Planner 5D and Its Three-Dimensional Liles 

27. Planner 5D was founded in 2011 as a user-friendly home design tool 
that allowed anyone to quickly and easily create their own home, office, or landscape 
designs. Website visitors select from thousands of available objects, from structural 
features such as windows, arches, doors, and stairs, to furniture such as sofas, beds, 
tables, chairs, and rugs, to kitchen and bathroom appurtenances such as baths and 
sinks, to electrical appliances such as lights, video equipment, and computers, and to 
exterior features such as paths, lawns, trees, plants, barbeques, and swimming pools. 
To create a design, users simply drag any of these objects onto or around a chosen 
floor plan. Once added to a design, these objects can be quickly and easily moved, 
rotated, tilted, re-sized, or otherwise manipulated to create the desired design. Users 
can easily toggle between two- and three-dimensional renderings of the design. In 
3D, a design can easily be rotated and tilted to any desired perspective. 

28. In the years since its founding. Planner 5D has become a leader in web- 
based interior design tools. It currently has over 40 million users worldwide. 

29. Planner 5D created its library of realistic, digitized objects over a span 
of more than seven years, at a cost of millions of dollars. Planner 5D continues to 
add to this library. Currently, the library contains over 4,500 objects. Each object 
individually, and the compilation of objects together, is an original work of 
authorship whose copyright belongs exclusively to Planner 5D. Planner 5D also 

_7_ 

Planner 5D's Complaint Case No. 






1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 


Case 3:19-cv-03132-SK Document 1 Filed 06/05/19 Page 9 of 22 


owns a copyright in the data file underlying each object, and in the compilation of 
individual data files. All works were authored in Europe or Russia, and neither 
Planner 5D nor any individual object modelers are nationals, domiciliaries, or 
habitual residents of the U.S., or legal entities with headquarters in the U.S. 

30. Planner 5D also owns a much larger compilation of design scenes made 
from arrangements of these individual objects. These scenes consist of floor plans 
created within the Planner 5D application using Planner 5D's objects. Planner 5D 
offers a wide variety of pre-existing scenes to users who might not want to start their 
designs from scratch. As with Planner 5D's objects, each scene in its collection was 
individually created by a human designer. Planner 5D's compilation of scenes (and 
underlying data files) now includes over 1,000,000 scenes. The copyright to this 
compilation belongs exclusively to Planner 5D. Further, the compilation was 
authored in Europe by Planner 5D, which is a Lithuanian corporation not 
headquartered in the U.S. 

31. Third parties can only access Planner 5D's objects and scenes using 
Planner 5D's proprietary software. Users navigate to the company's website, found 
at https://planner5d.com/, and there access the Planner 5D software. The software 
allows users to access individual objects and scenes. But under Planner 5D's Terms 
of Service, users' access and use of the objects and scenes is strictly limited. No user 
is permitted to 

collect, use, copy or distribute any portion of the Planner5D 
project or the Materials [defined as any materials found or 
created on the Planner 5D site]; resell, publicly perform or 
publicly display any portion of the Materials; modify or 
otherwise make any derivative uses of any portion of the 
Planner5D project, the Mobile applications or the Materials; 
use any "deep-link," "page-scrape," "robot," "spider" or other 
automatic device, program, algorithm or methodology which 
perform similar functions to access, acquire, copy, or monitor 
any portion of the Planner5D project;... download (other than 
page caching) any portion of the Planner5D project, the 
Materials or any information contained therein or use [of] the 
Planner5D project or the Materials other than for their 
intended purposes. 
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(Planner5D Terms of Service (effective April 18, 2012 through April 2018); accord 
Planner 5D Terms of Service (effective May 2018 through present).) 

32. These terms of service and the structure of Planner 5D's website 
prohibit users from directly accessing, downloading, or otherwise using the data files 
defining Planner 5D's objects and scenes (referred to here, respectively, as "object 
files" and "scene files"). Instead, users drag and drop the objects as rendered into 
scenes as rendered. Once the rendered objects are dropped into the rendered scenes, 
users can resize, reposition, or reorient them. What they may never do is access, use, 
or download the underlying data files. Neither may they make their own copies of 
the three-dimensional renderings of these files, nor use the renderings other than 
while on Planner 5D's website designing floor plans. 

33. In addition to the copyrights on the objects and scenes discussed above. 
Planner 5D's vast collection of data files for the objects and scenes are confidential 
and proprietary trade secrets of the company. These trade secrets, together with the 
company's copyrights, are the company's core assets. 

B. Planner 5D Evolves Into AI and Scene Recognition. 

34. As the importance and promise of scene-recognition technology grew 
in the years since Planner 5D's founding, the company's core business objective 
likewise evolved from providing home design tools to becoming a leader and 
innovator in computer scene recognition. 

35. The market for Al-enhanced software is expected to grow to $60 billion 
by 2025. One of Planner 5D's key goals has become leveraging its unparalleled 
repository of three-dimensional object and scene files to develop first-of-its-kind 
scene-recognition technology. To that end, over the past several years Planner 5D 
has invested significantly in developing algorithms that capitalize on Planner 5D's 
catalog of three-dimensional files to achieve market-leading 3D recognition. 
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C. Defendants' Identification, Scraping, Copying, And Use of 
Planner 5D's Files 

1. Princeton's Acquisition, Use, and Publication of 
Planner 5D's Object and Scene Files 

36. On information and belief, sometime in or before 2016, scene- 
recognition scientists at Princeton determined that large sets of realistic, digitized, 
three-dimensional scene and object data were critical to their research. In a 
December 30, 2016 academic paper on scene understanding, they wrote that 
"[ijndoor scene understanding is central to applications such as robot navigation and 
human companion assistance." (Yinda Zhang et ah, Physically-Based Rendering for 
Indoor Scene Understanding Using Convolutional Neural Networks, 1 (Proceedings of 
IEEE Conference on Computer Vision and Pattern Recognition, 2017), 
https://arxiv.org/pdf/1612.07429v2.pdf (last visited June 4, 2019).) The Princeton 
scientists noted that "[o]ver the last years, data-driven deep neural networks have 
outperformed many traditional approaches thanks to their representation learning 
capabilities." (Id.) 

37. Yet such successful data-driven methods had a built-in limitation: 
finding enough data. The Princeton researchers wrote: "One of the bottlenecks in 
training for better representations is the amount of available per-pixel ground truth 
data that is required for core scene understanding tasks." (Id.) As one of these 
authors separately wrote in a slide presentation he posted to a Princeton URL: "What 
is the main roadblock for 3D scene understanding and research?" "Data!!" 
(Funkhouser, supra, at 8-9.) 

38. "To address this problem," the Princeton scientists continued in their 
December 2016 article, others had proposed using synthetic data. Yet no one had 
explained where such synthetic data could be found. In their article, the Princeton 
authors solved this problem. Their solution: download all required data from 
Planner 5D. As the authors put it: "In this work, we introduce a large-scale synthetic 
dataset with 400K physically-based rendered images from 45K realistic 3D indoor 
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scenes." The data came from a "a collection of 3D scene models downloaded from 
the Planner 5D website." (Zhang et al, supra, at 1,3.) 

39. The Princeton authors explained that the downloaded Planner 5D 
dataset contained "45622 scenes with over 5000K instances of 2644 unique objects 
among 84 objects categories." (Id. at 3.) Special surfaces provided by Planner 5D 
gave the objects a desirable "photo-realistic" appearance. (Id.) Another key feature 
of the Planner 5D dataset was that "indoor layouts, furniture/object alignment, and 
surface materials are designed by people." (Id.) (emphasis added). Human-designed 
models and scenes were likely to be realistic. And realism was vital for accurate 
machine learning. (Id.) In that same 2016 article, the Princeton authors also 
announced they would be releasing their large trove of Planner 5D data to the public: 
"We will release our version of this data, together with minor improvements we 
have made (such as adding indoor light source labels . ..)." (Id.) 

40. This Princeton then did, calling the data the "SUNCG dataset." The 
dataset was posted to this Princeton URL: http://srmcg.cs.princeton.edu/ (now re¬ 
directed to Princeton's home page). In the ensuing years. Planner 5D's data figured 
prominently in the Princeton's researchers' work, including in further articles they 
published on scene recognition. (E.g., Shuran Song et al, Im2Pano3D: Extrapolating 
360° Structure and Semantics Beyond the Field of View, 8 (Proceedings of IEEE 
Conference on Computer Vision and Pattern Recognition, 2018), 
https://arxiv.org/pdf/1712.04569.pdf) (last visited June 4, 2019).) 

41. Planner 5D's data also became featured in the work of others. (E.g., 
Abhishek Das et al, Embodied Question Answering, 4 (Computer Vision and Pattern 
Recognition Expo, 2018), https://embodiedqa.org/paper.pdf) ("We instantiate 
EmbodiedQA in House3D [1], a recently introduced rich, simulated environment 
based on 3D indoor scenes from the SUNCG dataset [8]. Concretely, SUNCG 
consists of synthetic 3D scenes with realistic room and furniture layouts, manually 
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designed and crowdsourced using an online interior design interface (Planner5D 
[38]).").) 

42. Princeton's researchers have thus exploited, and continue to exploit. 
Planner 5D's core asset, and are doing so for the same purpose Planner 5D has set for 
itself: developing artificial intelligence applications featuring 3D scene recognition. 

43. On information and belief, to obtain the Planner 5D dataset, the 
Princeton researchers or others acting on their behalf executed a detailed, multi-step, 
systematic plan first to locate each of Planner 5D's object and scene files on 
Planner 5D's servers in Europe, and then to scrape those files to local data storage 
devices at Princeton. In order to locate the 2,644 objects and 45,622 scenes they 
ultimately downloaded, the Princeton researchers (or others acting on their behalf) 
designed and implemented computer code that would crawl page by page through 
thousands or tens of thousands of Planner 5D web pages to identify scraping targets. 
They then scraped each of the over 48,000 desired files from Planner 5D's servers. 

44. Planner 5D did not become aware of any of this until 2018. But it has 
since determined that more than 99.9% of the files in the SUNCG dataset are identical 
copies of files from Planner 5D's collection. On information and belief, the remaining 
.1% of the files are also downloaded Planner 5D files, but ones that have been slightly 
altered. Some of the SUNCG files even continue to bear Planner 5D's registered 
trademark, <PLANNER 5D>. 

45. As noted above. Planner 5D's Terms of Service expressly prohibit use of 
any "'page-scrape/ 'robot,' 'spider[,]' or other automatic device, program, algorithm 
or methodology which perform[s] similar functions[,] to access, acquire, copy, or 
monitor any portion of the Planner5D project." They likewise strictly prohibit 

"downloading] (other than page caching) any portion of the Planner5D project, the 
Materials or any information contained therein or use [of] the Planner5D project or 
the Materials other than for their intended purposes." 
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2. Facebook and the SUMO Challenge 

46. On information and belief, Facebook, Inc. and Facebook Technologies, 
LLC have also been acutely interested in scene-recognition technology. They have 
created and funded their own, in-house team of scientists and engineers to research 
and develop scene and object recognition and understanding. This research team 
operates, on information and belief, within Facebook's "Facebook Reality Labs," a 
major AR/VR (augmented reality / virtual reality) research center with offices across 
the United States. 

47. In 2018, Facebook Reality Labs launched its first Scene Understanding 
and Modeling (SUMO) Challenge. The SUMO Challenge "targets development of 
comprehensive 3D scene understanding and modeling algorithms." ( See Facebook 
Research, Facebook Reality Labs Launches the Scene Understanding and Modeling (SUMO) 
Challenge, Facebook Research (June 3,2019,5:53 PM), 

https://research.fb.com/facebook-reality-lab-launches-the-scene-understanding-and- 

modeling-sumo-challenge/ .J 

48. The SUMO Challenge was developed by a team of computer vision 
researchers at Facebook, with help from researchers at Stanford, Princeton, and 
elsewhere. (Id.) Current and former Stanford and Princeton researchers have also 
served as SUMO Challenge organizers, advisors, or program committee members. 

49. On information and belief, Facebook has supported Princeton and its 
researchers financially. For example, Princeton's "Vision & Robotics" Department 
has publicly thanked Facebook (among others) for its "generous support" "for our 
research." And former Princeton scene-recognition Ph.D student Shuran Song has 
been "supported by a Facebook Fellowship," according to an article she and five 
other Princeton scientists authored. (Shuran Song et ah, Semantic Scene Completion 
from a Single Depth Image 9 (Proceedings of IEEE Conference on Computer Vision and 
Pattern Recognition 2017), https://arxiv.org/pdf/1611.08974vl.pdf (last visited June 4, 
2019).) 
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50. SUMO Challenge contestants are "evaluated on their ability to 
consistently infer the correct geometry, pose, appearance and semantics of the 
elements" of scenes supplied by the Facebook researchers. (Id.) Facebook promised 
winners cash prizes and speaking spots at the SUMO Challenge conference. 

51. Facebook directed SUMO Challenge participants to the SUNGC dataset 
to develop and hone their contest submissions. On information and belief, Facebook, 
aided by others including Stanford and Princeton, made their own copy of the 
Princeton SUNCG dataset, posting it to a Stanford URL. On their SUMO Challenge 
web page, Facebook then posted a link to this Stanford SUNCG copy for access, 
downloading, and use by SUMO Challenge contestants. On information and belief, 
dozens of copies or more of this copy of the SUNCG dataset have been downloaded 
and used, by an unknown number of users. 

52. In 2019, the Facebook defendants launched another SUMO Challenge, 
the 2019 SUMO Challenge. 

53. Facebook also, on information and belief, made at least one other copy 
of the SUNCG dataset. It linked to this copy in another of its object-recognition 
projects, the "House 3D environment." According to Facebook, House 3D "is a rich 
environment containing thousands of human-designed 3D scenes of visually realistic 
houses with fully labeled 3D objects, textures, and scene layouts." Once again, these 
thousands of scenes came from Planner 5D. Facebook got them by "extract[ing 
them] from the SUNCG dataset." (See House3D, Facebook Artificial Intelligence 
(June 4, 2019, 5:56 PM), https://ai.facebook.com/tools/house3d .) 

54. Like Princeton, Facebook is exploiting the Planner 5D dataset for the 
same purpose Planner 5D has set for itself: to train artificial intelligence applications 
to recognize 3D interior scenes. Worse, Facebook explicitly secured from SUMO 
Challenge participants the right to commercialize the fruits of their work. This 
strikes at the heart of Planner 5D's business objective. 
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55. In March 2019, Planner 5D wrote Facebook, Princeton, and others, 
demanding that they cease and desist infringement of Planner 5D's copyrights. Yet 
Princeton and Facebook, on information and belief, nonetheless continue to use the 
SUNCG dataset in their computer vision R & D efforts, and to allow or encourage 
others' use of infringing copies of Planner 5D's copyrighted materials. 

56. Defendants' copying, misappropriation, and especially public 
disclosure and dissemination of Planner 5D's design files threatens to destroy the 
market for Planner 5D's core asset. It has inflicted catastrophic and potentially 
permanent damage on the company. 

FIRST CAUSE OF ACTION 
(Copyright Infringement — Against All Defendants) 

57. Planner 5D incorporates the prior paragraphs of this complaint as 
though fully set forth here. 

58. Planner 5D is the sole owner of all right, title, and interest in the 
copyrighted works whose infringement it is asserting here (the Copyrighted Works). 

59. By, among other things, duplicating, distributing, publicly displaying, 
and/or creating derivative works of the Copyrighted Works, the defendants, and 
each of them, directly infringed Planner 5D's copyrights, in violation of the copyright 
laws of the United States, including 17 U.S.C. section 101 et seq. 

60. The defendants have also contributorily and/or vicariously infringed 
Planner 5D's copyrights in the Copyrighted Works. 

61. For example, by encouraging researchers and SUMO contestants to 
make their own copies of, distribute, or publicly display Copyrighted Works they 
knew to be infringing, defendants committed contributory infringement. 

62. In addition or in the alternative, defendants vicariously infringed 
Planner 5D's copyrights. They had the right and the ability to supervise and control 
which models and scenes visitors to their websites were allowed to download, copy, 
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distribute, or publicly display. They selected the SUNCG dataset, a 2.5 terabyte 
collection of Planner 5D's copyright works. And, on information and belief, 
Facebook and Princeton financially benefitted from these activities. Facebook 
obtained unlimited rights to commercialize, market, and use the submissions of the 
SUMO Challenge contestants. Princeton's Computer Vision Group received 
"generous support" —presumably cash—from Facebook and other high-tech 
companies who benefitted from Princeton's sharing of its SUNCG dataset and its 
work with that data. Princeton stood to attract still further sponsorship through its 
continuing provision of resources, including the SUNCG dataset, to technology 
companies. 

63. On information and belief, the defendants' acts of direct, vicarious, and 
contributory infringement were intentional, willful, and malicious, and performed 
with knowledge that the works they or others were copying, selling, publicly 
displaying, or creating derivative works of were copyrighted works whose copyright 
they did not own and for which they lacked authorization to act as they acted, all in 
reckless disregard of Planner 5D's rights. 

64. The natural, probable, proximate, and foreseeable result of defendants' 
copyright infringement was to cause immense damage to Planner 5D, and to secure 
profits for themselves. And the defendants' copyright infringement in fact did cause 
Planner 5D immense damage. 

65. Planner 5D is entitled to disgorge defendants' profits, and to recover its 
actual damages, all in an amount to be determined at trial. Planner 5D is also 
entitled to a permanent injunction prohibiting continuing or future infringement of 
its rights, and ordering destruction of all infringing copies. 
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SECOND CAUSE OF ACTION 
(Trade Secret Misappropriation Under the 
Defend Trade Secrets Act — Against All Defendants) 

66. Planner 5D incorporates the prior paragraphs of this complaint as 
though fully set forth here. 

67. The data files defining the objects created by Planner 5D, and those 
defining Planner 5D's vast compilation of scenes (i.e., Planner 5D's object and data 
files), are trade secrets belonging to Planner 5D. Planner 5D takes reasonable 
measures to preserve their secrecy, they are not generally known to, or readily 
ascertainable through proper means by, the public, and they derive independent 
economic value from not being generally known or readily ascertainable. 

68. By, among other things, crawling through thousands of Planner 5D 
web pages to identify each of Planner 5D's object and scene files, then scraping those 
files from tens of thousands of further addresses on Planner 5D's servers, as well as 
by committing the other acts and omissions described above, Princeton acquired 
Planner 5D's trade secrets through improper means. Its acquisition, disclosure, and 
use of the trade secrets constituted trade secret misappropriation. 

69. By, among other things, continuing to use Planner 5D's trade secrets 
even after Facebook and Facebook Technologies knew and had reason to know the 
secrets had been acquired by Princeton through improper means, and/or had been 
acquired under circumstances giving rise to Princeton's duty to maintain their 
secrecy or limit their use, and/or had been derived from Princeton which owed 
Planner 5D a duty to maintain the secrecy or limit the use of Planner 5D's trade 
secrets, the Facebook defendants misappropriated Planner 5D's trade secrets. 

70. On information and belief, the defendants' acts of trade secret 
misappropriation were intentional, willful, and malicious, and performed with 
knowledge that the secrets misappropriated belonged to Planner 5D and not the 
defendants. 
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71. The trade secrets misappropriated here relate to a product and a service 
that are used in, and are intended for use in, interstate and foreign commerce. 

72. The natural, probable, proximate, and foreseeable result of defendants' 
trade secret misappropriations was to cause immense damage to Planner 5D, and to 
unjustly enrich the defendants. And the misappropriations in fact did cause 
immense damage to Planner 5D, and did unjustly enrich the defendants, all in 
amounts to be proved at trial. 

73. Planner 5D is entitled to recover damages for the actual loss caused by 
defendants' misappropriation, the (non-duplicative) unjust enrichment defendants 
received, and exemplary damages of up to twice the damages award, all as 
determined at trial. Planner 5D is also entitled to a permanent injunction prohibiting 
continuing or future trade secret misappropriation, destruction of all 
misappropriated trade secrets, and attorneys' fees and costs. 

THIRD CAUSE OF ACTION 
(Trade Secret Misappropriation Under the 
California Uniform Trade Secrets Act — Against All Defendants) 

74. Planner 5D incorporates the prior paragraphs of this complaint as 
though fully set forth here. 

75. The object files created by Planner 5D, and its vast compilation of scene 
files, are trade secrets belonging to Planner 5D. Planner 5D takes reasonable 
measures to preserve their secrecy, they are not generally known to, or readily 
ascertainable through proper means by, the public, and they derive independent 
economic value from not being generally known or readily ascertainable. 

76. By, among other things, crawling through thousands of Planner 5D 
web pages to identify each of Planner 5D's object and scene files, then scraping those 
files from tens of thousands of further addresses on Planner 5D's servers, as well as 
by committing the other acts and omissions described above, Princeton acquired 
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Planner 5D's trade secrets through improper means. Its acquisition, disclosure, and 
use of the trade secrets constituted trade secret misappropriation. 

77. By, among other things, continuing to use Planner 5D's trade secrets 
even after Facebook and Facebook Technologies knew and had reason to know the 
secrets had been acquired by Princeton through improper means, and/or had been 
acquired under circumstances giving rise to Princeton's duty to maintain their 
secrecy or limit their use, and/or had been derived from Princeton which owed 
Planner 5D a duty to maintain the secrecy or limit the use of Planner 5D's trade 
secrets, the Facebook defendants misappropriated Planner 5D's trade secrets. 

78. On information and belief, the defendants' acts of trade secret 
misappropriation were intentional, willful, and malicious, and performed with 
knowledge that the secrets misappropriated belonged to Planner 5D and not the 
defendants. 

79. The natural, probable, proximate, and foreseeable result of defendants' 
trade secret misappropriations was to cause immense damage to Planner 5D, and to 
unjustly enrich the defendants. And the misappropriations in fact did cause 
immense damage to Planner 5D, and did unjustly enrich the defendants, all in 
amounts to be proved at trial. 

80. Planner 5D is entitled to recover damages for the actual loss caused by 
defendants' misappropriation, the (non-duplicative) unjust enrichment defendants 
received, and exemplary damages of up to twice the damages award, all as 
determined at trial. Planner 5D is also entitled to a permanent injunction prohibiting 
continuing or future trade secret misappropriation, destruction of all 
misappropriated trade secrets, and attorneys' fees and costs. 
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PRAYER FOR RELIEF 

Planner 5D prays for judgment on each cause of action against the defendants, 
and each of them, and for the following further relief: 

a. for copyright damages, including Planner 5D's actual damages and 
for any (non-duplicative) profits of the defendants; 

b. for trade secret damages, including the actual loss caused by the 
defendants' misappropriation, plus any (non-duplicative) unjust 
enrichment received by the defendants, all in no event less than a 
reasonable royalty for the defendants' disclosure or use of 
Planner 5D's trade secrets; 

c. for exemplary damages of up to two times the trade secret damages 
awarded; 

d. for Planner 5D's reasonable attorneys' fees and costs, including a 
reasonable sum to cover the costs of third-party expert witnesses; 

e. for pre- and post-judgment interest on all awards for which they are 
available; 

f. for permanent injunctive relief prohibiting all defendants, their 
officers, agents, successors, and assigns, and all persons acting in 
concert with them, from further acts of direct or indirect copyright 
infringement or of trade secret misappropriation; 

g. for an order requiring the destruction of all infringing copies and all 
misappropriated trade secrets; and 

h. for such other relief as the Court deems just and proper. 
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DEMAND FOR JURY TRIAL 

Planner 5D demands a jury trial on all issues qualifying for one. 

RESPECTFULLY SUBMITTED, 


DATED: June 5, 2019 

THE BUSINESS LITIGATION GROUP, P.C. 

Bv: /s/ MarcN. Bernstein 

Marc N. Bernstein 


Attorneys for Plaintiff 

UAB "PLANNER5D" 
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